• The 1st Agriculture-Vision Challenge: Methods and Results 

      Chiu, Mang Tik; Xingqiang, Xu; Wang, Kai; Hobbs, Jennifer; Hovakimyan, Naira; Huang, Thomas S.; Shi, Honghui; Wei, Yunchao; Huang, Zilong; Schwing, Alexander; Brunner, Robert; Dozier, Ivan; Dozier, Wyatt; Ghandilyan, Karen; Wilson, David; Park, Hyunseong; Kim, Junhee; Kim, Sungho; Liu, Qinghui; Kampffmeyer, Michael; Jenssen, Robert; Salberg, Arnt Børre; Barbosa, Alexandre; Trevisan, Rodrigo; Zhao, Bingchen; Yu, Shaozuo; Yang, Siwei; Wang, Yin; Sheng, Hao; Chen, Xiao; Su, Jingyi; Rajagopal, Ram; Ng, Andrew; Huynh, Van Thong; Kim, Soo-Hyung; Na, In-Seop; Baid, Ujjwal; Innani, Shubham; Dutande, Prasad; Baheti, Bhakti; Talbar, Sanjay; Tang, Jianyu (Chapter; Bokkapittel, 2020-07-28)
      The first Agriculture-Vision Challenge aims to encourage research in developing novel and effective algorithms for agricultural pattern recognition from aerial images, especially for the semantic segmentation task associated with our challenge dataset. Around 57 participating teams from various countries compete to achieve state-of-the-art in aerial agriculture semantic segmentation. The Agriculture-Vision ...
    • Analysis of Deep Convolutional Neural Networks Using Tensor Kernels and Matrix-Based Entropy 

      Wickstrøm, Kristoffer; Løkse, Sigurd Eivindson; Kampffmeyer, Michael; Yu, Shujian; Príncipe, José C.; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-06-03)
      The aquaculture industry is expanding to meet the daily requirements of humanity from high-quality seafood. In this regard, intensive aquaculture systems are suggested, resulting in high production but being challenged with immunosuppression and disease invaders. Antibiotics were used for a long time to protect and treat aquatic animals; however, continuous use led to severe food safety issues, ...
    • Anomaly detection-inspired few-shot medical image segmentation through self-supervision with supervoxels 

      Hansen, Stine; Gautam, Srishti; Jenssen, Robert; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-02-11)
      Recent work has shown that label-efficient few-shot learning through self-supervision can achieve promising medical image segmentation results. However, few-shot segmentation models typically rely on prototype representations of the semantic classes, resulting in a loss of local information that can degrade performance. This is particularly problematic for the typically large and highly heterogeneous ...
    • A clinically motivated self-supervised approach for content-based image retrieval of CT liver images 

      Wickstrøm, Kristoffer; Østmo, Eirik Agnalt; Radiya, Keyur; Mikalsen, Karl Øyvind; Kampffmeyer, Michael; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-05-09)
      Deep learning-based approaches for content-based image retrieval (CBIR) of computed tomography (CT) liver images is an active field of research, but suffer from some critical limitations. First, they are heavily reliant on labeled data, which can be challenging and costly to acquire. Second, they lack transparency and explainability, which limits the trustworthiness of deep CBIR systems. We address ...
    • Deep generative models for reject inference in credit scoring 

      Andrade Mancisidor, Rogelio; Kampffmeyer, Michael; Aas, Kjersti; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-05-21)
      Credit scoring models based on accepted applications may be biased and their consequences can have a statistical and economic impact. Reject inference is the process of attempting to infer the creditworthiness status of the rejected applications. Inspired by the promising results of semi-supervised deep generative models, this research develops two novel Bayesian models for reject inference in credit ...
    • Deep Image Translation With an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection 

      Luppino, Luigi Tommaso; Kampffmeyer, Michael; Bianchi, Filippo Maria; Moser, Gabriele; Serpico, Sebastiano Bruno; Jenssen, Robert; Anfinsen, Stian Normann (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-02-17)
      Image translation with convolutional neural networks has recently been used as an approach to multimodal change detection. Existing approaches train the networks by exploiting supervised information of the change areas, which, however, is not always available. A main challenge in the unsupervised problem setting is to avoid that change pixels affect the learning of the translation function. We propose ...
    • Deep Semi-Supervised Semantic Segmentation in Multi-Frequency Echosounder Data 

      Choi, Changkyu; Kampffmeyer, Michael; Jenssen, Robert; Handegard, Nils Olav; Salberg, Arnt-Børre (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-02-01)
      Multi-frequency echosounder data can provide a broad understanding of the underwater environment in a non-invasive manner. The analysis of echosounder data is, hence, a topic of great importance for the marine ecosystem. Semantic segmentation, a deep learning based analysis method predicting the class attribute of each acoustic intensity, has recently been in the spotlight of the fisheries and aquatic ...
    • Dense dilated convolutions merging network for land cover classification 

      Liu, Qinghui; Kampffmeyer, Michael; Jenssen, Robert; Salberg, Arnt Børre (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-03-06)
      Land cover classification of remote sensing images is a challenging task due to limited amounts of annotated data, highly imbalanced classes, frequent incorrect pixel-level annotations, and an inherent complexity in the semantic segmentation task. In this article, we propose a novel architecture called the dense dilated convolutions' merging network (DDCM-Net) to address this task. The proposed ...
    • Explaining decisions of deep neural networks used for fish age prediction 

      Ordonez, Alba; Eikvil, Line; Salberg, Arnt-Børre; Harbitz, Alf; Murray, Sean Meling; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-06-19)
      Age-reading of fish otoliths (ear stones) is important for the sustainable management of fish resources. However, the procedure is challenging and requires experienced readers to carefully examine annual growth zones. In a recent study, convolutional neural networks (CNNs) have been demonstrated to perform reasonably well on automatically predicting fish age from otolith images. In the present study, ...
    • Federated Partially Supervised Learning With Limited Decentralized Medical Images 

      Dong, Nanqing; Kampffmeyer, Michael; Voiculescu, Irina; Xing, Eric (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-12-20)
      Data government has played an instrumental role in securing the privacy-critical infrastructure in the medical domain and has led to an increased need of federated learning (FL). While decentralization can limit the effectiveness of standard supervised learning, the impact of decentralization on partially supervised learning remains unclear. Besides, due to data scarcity, each client may have access ...
    • Generating customer's credit behavior with deep generative models 

      Andrade Mancisidor, Rogelio; Kampffmeyer, Michael; Aas, Kjersti; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-03-17)
      Banks collect data x<sub>1</sub> in loan applications to decide whether to grant credit and accepted applications generate new data x<sub>2</sub> throughout the loan period. Hence, banks have two measurement-modalities, which provide a complete picture about customers. If we can generate x<sub>2</sub> conditioned on x<sub>1</sub> keeping the relationship between these two modalities, credit and ...
    • Hubs and Hyperspheres: Reducing Hubness and Improving Transductive Few-shot Learning with Hyperspherical Embeddings 

      Trosten, Daniel Johansen; Chakraborty, Rwiddhi; Løkse, Sigurd Eivindson; Wickstrøm, Kristoffer; Jenssen, Robert; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-08-22)
      Distance-based classification is frequently used in transductive few-shot learning (FSL). However, due to the high-dimensionality of image representations, FSL classifiers are prone to suffer from the hubness problem, where a few points (hubs) occur frequently in multiple nearest neighbour lists of other points. Hubness negatively impacts distance-based classification when hubs from one class appear ...
    • Joint optimization of an autoencoder for clustering and embedding 

      Boubekki, Ahcene; Kampffmeyer, Michael; Brefeld, Ulf; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-06-21)
      Deep embedded clustering has become a dominating approach to unsupervised categorization of objects with deep neural networks. The optimization of the most popular methods alternates between the training of a deep autoencoder and a k-means clustering of the autoencoder’s embedding. The diachronic setting, however, prevents the former to beneft from valuable information acquired by the latter. In ...
    • The Kernelized Taylor Diagram 

      Wickstrøm, Kristoffer; Johnson, Juan Emmanuel; Løkse, Sigurd Eivindson; Camps-Valls, Gusatu; Mikalsen, Karl Øyvind; Kampffmeyer, Michael; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-02-02)
      This paper presents the kernelized Taylor diagram, a graphical framework for visualizing similarities between data populations. The kernelized Taylor diagram builds on the widely used Taylor diagram, which is used to visualize similarities between populations. However, the Taylor diagram has several limitations such as not capturing non-linear relationships and sensitivity to outliers. To address ...
    • Learning latent representations of bank customers with the Variational Autoencoder 

      Andrade Mancisidor, Rogelio; Kampffmeyer, Michael; Aas, Kjersti; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-09-15)
      Learning data representations that reflect the customers’ creditworthiness can improve marketing campaigns, customer relationship management, data and process management or the credit risk assessment in retail banks. In this research, we show that it is possible to steer data representations in the latent space of the Variational Autoencoder (VAE) using a semi-supervised learning framework and a ...
    • M3D-VTON: A Monocular-to-3D Virtual Try-On Network 

      Zhao, Fuwei; Xie, Zhenyu; Kampffmeyer, Michael; Dong, Haoye; Han, Songfang; Zheng, Tianxiang; Zhang, Tao; Liang, Xiaodan (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-02-28)
      Virtual 3D try-on can provide an intuitive and realistic view for online shopping and has a huge potential commercial value. However, existing 3D virtual try-on methods mainly rely on annotated 3D human shapes and garment templates, which hinders their applications in practical scenarios. 2D virtual try-on approaches provide a faster alternative to manipulate clothed humans, but lack the rich and ...
    • Mixing up contrastive learning: Self-supervised representation learning for time series 

      Wickstrøm, Kristoffer; Kampffmeyer, Michael; Mikalsen, Karl Øyvind; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-02-14)
      The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is key to enabling transfer learning, which is especially beneficial for medical applications, where there is an abundance of data but labeling is costly and time ...
    • Multi-View Self-Constructing Graph Convolutional Networks With Adaptive Class Weighting Loss for Semantic Segmentation 

      Liu, Qinghui; Kampffmeyer, Michael; Jenssen, Robert; Salberg, Arnt Børre (Conference object; Konferansebidrag, 2020-07-28)
      We propose a novel architecture called the Multi-view Self-Constructing Graph Convolutional Networks (MSCG-Net) for semantic segmentation. Building on the recently proposed Self-Constructing Graph (SCG) module, which makes use of learnable latent variables to self-construct the underlying graphs directly from the input features without relying on manually built prior knowledge graphs, we leverage ...
    • Negational symmetry of quantum neural networks for binary pattern classification 

      Dong, Nanqing; Kampffmeyer, Michael; Voiculescu, Irina; Xing, Eric (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-04-27)
      Although quantum neural networks (QNNs) have shown promising results in solving simple machine learning tasks recently, the behavior of QNNs in binary pattern classification is still underexplored. In this work, we find that QNNs have an Achilles’ heel in binary pattern classification. To illustrate this point, we provide a theoretical insight into the properties of QNNs by presenting and analyzing ...
    • On the Effects of Self-supervision and Contrastive Alignment in Deep Multi-view Clustering 

      Trosten, Daniel Johansen; Løkse, Sigurd Eivindson; Jenssen, Robert; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-08-22)
      Self-supervised learning is a central component in recent approaches to deep multi-view clustering (MVC). However, we find large variations in the development of self-supervision-based methods for deep MVC, potentially slowing the progress of the field. To address this, we present Deep-MVC, a unified framework for deep MVC that includes many recent methods as instances. We leverage our framework to ...